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ABSTRACT 

The  Maximum  Likelihood  Probabilistic  Multi-Hypothesis  tracker  (ML-PMHT)  is  an  algorithm  that  works  well 
against  low-SNR  targets  in  an  active  multistatic  framework  with  multiple  transmitters  and  multiple  receivers. 
The  ML-PMHT  likelihood  ratio  formulation  allows  for  multiple  targets  as  well  as  multiple  returns  from  any 
given  target  in  a  single  scan,  which  is  realistic  in  a  multi-receiver  environment  where  data  from  different  re¬ 
ceivers  is  combined  together.  Additionally,  the  likelihood  ratio  can  be  optimized  very  easily  and  rapidly  with 
the  expectation-maximization  (EM)  algorithm.  Here,  we  apply  ML-PMHT  to  two  multistatic  data  sets:  the  TNO 
Blind  2008  data  set  and  the  Metron  2009  data  set.  Results  are  compared  with  previous  work  that  employed  the 
Maximum  Likelihood  Probabilistic  Data  Assocation  (ML-PDA)  tracker,  an  algorithm  with  a  different  assign¬ 
ment  algorithm  and  as  a  result  a  different  likelihood  ratio  formulation. 

Keywords:  ML-PDA,  ML-PMHT,  Multistatic,  Bistatic  Active  Sonar,  Target  Tracking,  Expectation  Maximization, 
EM 


1.  INTRODUCTION 

The  Maximum  Likelihood  Probabilistic  Multi-Hypothesis  (ML-PMHT)  tracker  was  applied  to  two  data  sets 
provided  by  the  Multistatic  Tracking  Working  Group  (MSTWG).  The  first  data  set  was  the  TNO  Blind  data  set, 
a  synthetic  data  set  created  in  2008  [3]  with  three  moving  source-receiver  pairs  tracking  four  relatively  high 
strength  targets.  The  second  data  set  was  the  Metron  synthetic  data  set,  featuring  five  scenarios,  each  with  four 
transmitters  and  25  receivers.  This  dataset  was  produced  in  2009  and  is  described  in  [7]. 

Tracking  results  from  the  ML-PMHT  tracker  are  compared  to  results  on  the  the  same  datasets  using  a  dif¬ 
ferent  algorithm,  the  Maximum  Likelihood  Probabilistic  Data  Association  (ML-PDA)  tracker.  Results  using 
ML-PDA  on  these  datasets  were  presented  in  2010  [8]  and  are  are  summarized  here. 

2.  ML-PMHT  AND  ML-PDA  TRACKERS 

The  Maximum  Likelihood  Probabilistic  Multi-Hypothesis  algorithm  is  a  batch  tracker  that  assumes  some  pa¬ 
rameterized,  deterministic  motion  for  a  target.  It  makes  some  simple  assumptions  about  a  target  and  its  sur¬ 
rounding  environment,  and  then  maximizes  the  likelihood  ratio  that  results  from  these  assumptions.  In  some 
ways,  it  is  very  similar  to  the  Maximum  Likelihood  Probabilistic  Data  Association  algorithm  (ML-PDA);  the 
main  difference  between  the  two  algorithms  is  in  the  target  assignment  model.  For  ML-PMHT,  multiple  mea¬ 
surements  in  a  single  frame  (scan)  can  be  assigned  to  a  target;  with  ML-PDA,  at  most  one  measurement  can 
be  assigned  to  a  target  in  a  single  scan.  The  ML-PMHT  likelihood  ratio  was  first  formulated  for  the  PMHT 
algorithm  in  [1],  [9],  [10]  and  [11].  It  was  implemented  in  a  maximum-likelihood  implementation  in  a  bistatc 
active  application  in  [13]  and  [12],  which  is  how  we  currently  employ  it. 

°The  authors  e-mails  are  steven.schoenecker@navy.mil  and  {willett,  ybs}@engr.uconn.edu. 
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2.1  ML-PMHT  likelihood  ratio 


The  idea  behind  ML-PMHT  is  actually  very  simple.  We  assume  we  have  a  target  with  some  parameterized, 
deterministic  motion  in  the  presence  of  clutter.  With  some  basic  assumptions,  we  can  formulate  a  likelihood 
ratio  and  find  the  maximum.  The  ML-PMHT  assumptions  are: 

•  A  single  target  is  present  in  each  frame  with  known  detection  probability  Pd .  Detections  are  independent 
across  frames.  (However,  it  is  easy  to  extend  ML-PMHT  to  multiple  targets.) 

•  Any  number  of  the  measurements  in  the  frame  can  be  assigned  to  the  target  (again,  this  is  the  major 
difference  between  ML-PMHT  and  ML-PDA). 

•  The  kinematics  of  the  target  are  deterministic.  The  motion  is  usually  parameterized  as  a  straight  line, 
although  any  other  parameterization  is  valid. 

•  False  detections  are  uniformly  distributed  in  the  search  volume. 

•  The  number  of  false  detections  is  Poisson  distributed  with  known  clutter  density. 

•  Amplitudes  of  target  and  false  detections  are  Rayleigh  distributed.  The  parameter  of  each  Rayleigh  dis¬ 
tribution  is  known  (although  the  SNR  may  be  tracked  [6]). 

•  Target  measurements  are  corrupted  with  zero-mean  Gaussian  noise. 

•  Measurements  at  different  times,  conditioned  on  the  parameterized  state,  are  independent. 

Using  these  assumptions,  we  can  develop  the  ML-PMHT  likelihood  ratio  as  follows.  The  pdf  under  the 
target  present  hypothesis  for  the  entire  set  of  measurements  at  time  (frame)  i  conditioned  on  the  unknown 
target  parameter  (vector)  x  is 

rrii 

Pl[Z(i)\x\  =  H  ^yPo[aj(i)\  +7rip[zj(f)|x]p[[oj(f)]}  (1) 

i=i 

Here,  V  is  the  search  volume,  7To  is  the  probability  that  a  measurement  is  from  clutter  and  ni  is  the  probability 
that  a  measurement  is  from  the  target.  Next,  p£  (a)  is  the  pdf  of  a  false  alarm  measurement  amplitude  condi¬ 
tioned  on  its  exceeding  the  threshold  r,  (a)  is  the  pdf  of  the  target  measurement  amplitude  conditioned  on  its 
exceeding  the  threshold,  and  p[z,,  (z)|x]  is  a  target-centered  Gaussian.  It  is  also  important  to  note  that  there  are 
three  different  notational  forms  for  measurements  in  this  paper.  First,  z j(i)  refers  to  a  single  measurement,  the 
jth  measurement  in  the  ith  frame.  Next,  Z(i)  refers  to  the  set  of  measurements  in  the  ith  scan.  Finally,  Z  refers 
to  the  set  of  all  measurements  in  the  batch  of  data  (i.e.  combining  all  the  scans  for  i  =  1, ...,  Nw). 

The  pdf  under  the  target  absent  hypothesis  is  expressed  as 

mi  , 

Po[Z(i)\x]  =  yPl[aj{i)\  (2) 

i=i 

Since  one  of  the  assumptions  listed  above  is  that  measurements  at  different  times,  conditioned  on  the  param¬ 
eterized  state,  are  independent,  we  can  write  the  likelihood  ratio  of  a  batch,  or  window  of  data  of  length  Nw 
as 

/  y  n  Nw  rrii 

pp\zl) =nn{7ro+7ri^[zjwix^(*)}  (3) 

i—\  j= 1 

where  pj  ( i )  is  the  ratio  of  p\  [ay  (z)]  to  Pq  [ dj  (z)] .  Thus,  the  log-likelihood  ratio  can  be  written  as 

Nw  rrii 

Mz\x)  =  $IXlln{7ro  +  7riVrp[zf(*)lx]Pj(*)}  (4) 

z=i  j= i 
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2.2  ML-PMHT  Maximization 

An  advantage  of  the  ML-PMHT  log-likelihood  ratio  formulation  is  that  it  can  be  optimized  with  a  closed-form 
expression  using  expectation  maximization  [4].  As  long  as  there  is  a  linear  relationship  between  the  state  x  and 
the  predicted  measurement  z,  we  can  write  the  cost  function  J(x,  Z)  as 

Nw  rrii 

=  EE{lzJ'(*)  -Hx]TR^[Zj(t)  -  Hx]  +  ln(|27rRj_,|)|wj(«)  (5) 

*= i  i= i 


Here,  H  is  the  measurement  matrix,  R,;  is  the  measurement  covariance  matrix  for  the  jth  measurement  in 
the  ith  scan,  and  Wj  (t)  is  the  association  probability  of  the  measurement.  The  EM  algorithm  for  this  case  in¬ 
volves  iteratively  calculating  Wj(i)  and  then  using  this  value  to  solve  for  the  minimum  of  equation  (5)  [1].  The 
expression  for  Wj  (i)  is 


Wj(i) 


7rlP\zj  (i)\x]pj(i) 
tt0/V  +  w1p[zj(i)\x]pj(i) 


(6) 


As  long  as  the  relationship  between  the  state  and  the  predicted  measurement  z  is  linear,  as  is  implied  in  equation 
(5),  the  minimization  of  this  cost  function  is  easily  done  and  is  given  by 


Nw  mi 


Nw  rrii 


EEwi whTr-Eh]  E E wi w 


i=  1  j— 1  i= 1  j= 1 

The  state  vector  x  in  this  application  is  a  4x1  vector, 

X  =  [x0  x  y0  y]T 


(7) 

(8) 


where  Xo  and  y o  are  the  target  positions  at  the  beginning  of  the  batch.  When  the  measurements  are  two- 
dimensional  (x  and  y  positions),  the  relationship  between  x  and  z  is  linear  and  equation  7  can  be  used  directly. 
When  the  measurements  are  three-dimensional  (x  and  y  positions  and  range-rate),  this  linear  relationship  no 
longer  holds.  At  this  point,  the  measurement  matrix  is  no  longer  a  constant,  but  is  a  function  of  x.  The  calculated 
bistatic  range-rate  r,  for  the  state  x,  is  given  by  [2] 

1  {x  -  xr)(±  -  xr)  +  (y  -  yr)(y  -  yr)  1  (x  -  xs)(x  -  xs)  +  (y  -  ys)(y  -  ys) 

r  x  = - - (y) 

1  2  Rtr  2  Rts  V 

Here,  ( xr ,  yr)  and  (xs,  ys )  are  the  positions  of  the  receiver  and  source,  (i;r.  y, )  are  the  receiver  velocity  compo¬ 
nents,  (xs,  i/s)  are  the  source  velocity  components,  Rtr  is  the  distance  from  the  receiver  to  the  target,  and  Rts 
is  the  distance  from  the  source  to  the  target.  The  predicted  measurement  in  this  case  is 


z(x) 


Hx 

f(x) 


(10) 


where 


H  = 


1  t  0  0 
0  0  1  t 


(11) 


In  order  to  get  equation  10  into  the  proper  form,  it  is  necessary  to  linearize  the  predicted  Doppler  with  a  first- 
order  Taylor  series  expansion. 

f(x)  «  f(x0)  +  Vf(x0)T(x  -  x0)  (12) 

Inserting  equation  12  into  equation  10  produces 


z(x) 


H 

Vf(x0)T 


0 

0 

r(x0)  -  Vf(x0)Tx0 


(13) 
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Now,  the  vector  on  the  right-side  of  the  equation  is  shifted  to  the  left  side  of  the  equation  to  create  a  modified 
measurement,  and  the  relationship  between  the  modified  measurement  and  the  state  is  now  is  the  desired  linear 
form 


z  =  Hx 


(14) 


where 


and 


z  =  z  — 


0 

0 

f(x0)  -  Vf(x0)Tx0 


H  = 


H 

Vf(x0)T 


(15) 


(16) 


The  gradient  is  somewhat  messy  algebraically  and  is  provided  here  for  convenience.  For  ease  of  notation,  let 

{x,yYR’s}  =  ({x,y}  -  {x,  y}{r,s})  and  {x,  y}^R’S^  =  ({*,  y}  -  {x,  y}{r>s})-  Then, 


Vf(x) 


1 

2 


yR(yRx---x“y- 

M5 


ys(ysxs-xsys) 


t(v*ai*->V*V*)+**3+**^2 

Rd  I 

^ TR 

xR(xRyR—yRxR)  ,  xs  (xs  ys —ys  xs) 
- 33 - - 


t(ys2xs-xsvsys)+xs3+xsvs2 

- 13 - 


m 


Ri 


t(xR2yRT-yRxRxR)+yR3+yRTxR2  t(xs2ys -ys  xs  xs)+ys3 +ys  xs2 


^tr 


RTs 


(17) 


2.3  Doppler  Clutter  Modfication  of  ML-PMHT 

In  [8],  an  "MTI  deweighting  scheme"  was  developed  for  the  ML-PDA  tracker.  This  is  used  when  there  is 
information  on  the  distribution  of  the  Doppler  from  the  clutter  measurements.  In  this  work,  assuming  that  the 
clutter  Doppler  had  a  zero-mean  Gaussian  distribution  with  variance  a2,  the  de weighting  term  was  given  as 


gdj(i)  /2a 

CM/CO]  =  J_  di  (i)2 /2a2 

rrii  ^l—  1  ° 


(18) 


Since  it  is  desired  to  compare  the  performance  of  ML-PMHT  against  that  of  ML-PDA,  this  deweighting  term  is 
incorporated  into  the  ML-PMHT  likelihood  ratio  in  the  following  manner.  The  likelihood  ratio,  from  equation 
4,  is  re-written  as 

(19) 

The  last  term  in  this  equation,  1  /m*,  is  recognized  as  the  MTI  deweighting  term  when  there  is  no  information 
on  the  Doppler  clutter  -  i.e.  the  Doppler  clutter  has  a  uniform  distribution.  This  term  is  simply  replaced  by 

<&(*)]  to  give 

Nw  mi 

A(^lx)  =  X] ln  I71-0  +  7riTrp[zi(f)|x]pJ(f)miC[dj(f)]|  (20) 

*=i  3=1 

This  form  of  the  ML-PMHT  likelihood  ratio  was  used  for  performance  comparison  with  the  ML-PDA  algorithm 
in  this  work. 


A(Z|x)  = 


Nw  mi 

EE 

*= 1  3=1 


In  <  7T0  +  niVp[zj(i)\x]pj(i) 


2.4  ML-PMHT  track  initialization 

Tracks  for  ML-PMHT  were  initiated  with  a  grid-based  scheme.  Over  the  2-dimensional  positional  search  vol¬ 
ume,  points  were  evenly  spaced  in  both  the  x  and  y  directions  every  1000  meters.  At  each  (x,  y)  grid  location, 
the  ML-PMHT  log-likelihood  ratio  was  evaluated  for  a  variety  of  velocity  directions  and  magnitudes.  Out  of 
all  the  log-likelihood  values  resulting  from  this  grid  evaluation,  the  top  200  (along  with  their  corresponding  po¬ 
sitional  and  velocity  initialization  vectors)  were  retained.  The  initialization  vector  that  produced  the  maximum 
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likelihood  ratio  was  saved,  and  other  initialization  vectors  that  were  essentially  duplicates  of  this  first  vector 
were  removed.  The  measurements  associated  with  the  first  maximum  LLR  value  as  well  as  the  duplicates  were 
excised  from  the  data,  and  the  LLR  values  were  recomputed.  Again,  the  vector  that  produced  the  largest  LLR 
value  was  saved,  and  again,  duplicate  initialization  vectors  were  removed.  This  process  was  repeated  until  no 
duplicates  remained.  Then,  all  the  saved  initialization  vectors  were  optimized  with  EM,  and  the  above  process 
of  removing  any  duplicate  initialization  vectors  was  repeated  until  only  unique  solutions  remained.  A  simple 
example  (with  only  10  initial  LLR  values)  is  provided  to  help  illustrate  this  method.  Let  the  top  ten  LLR  values 
resulting  from  the  grid  initialization  be 

LLR  vector  =  [10  10.5  9.4  14.2  8.1  8.3  12.5  6.8  6.7  10.6]  (21) 

Next,  xmax,  the  initialization  vector  that  produced  the  maximum  LLR  value  (in  this  case  14.2)  was  selected  and 
saved  as  a  potential  track  initialization  point.  Then,  association  values  for  all  measurements  in  the  batch  were 
calculated  with  equation  (6),  with  x  replaced  by  xrnax.  Now,  any  measurements  that  had  an  association  value 
greater  than  or  equal  to  0.1  were  excised  from  the  batch  of  data.  The  LLR  was  subseqently  recomputed  on  this 
reduced  data  set.  In  this  example,  let  the  LLR  vector  from  excized  data  come  out  to 

Excised  LLR  vector  =  [0.2  0.1  9.4  0.0  8.1  8.3  12.5  6.8  6.7  10.2]  (22) 

The  ratio  between  the  two  vectors  is  taken.  In  the  case  of  the  example,  the  ratio  vector  is 

LLR  ratio  =  [0.02  0.01  1.00  0.00  1.00  1.00  1.00  1.00  1.00  0.96]  (23) 

The  initial  state  vectors  that  correspond  to  any  LLR  ratio  value  less  than  0.5  are  discarded  as  "repeats"  of 
the  initial  maximum  LLR  solution  vector  xmax.  In  the  case  of  the  example,  we  would  discard  the  first  and 
second  initialization  vectors  (the  xmax  vector  would  also  be  removed,  but  it  had  been  previously  saved  as 
a  track  initialization  point).  The  basic  idea  here  is  that  we  are  finding  all  measurements  that  are  associated 
with  xmax .  If  we  remove  those  measurements  and  then  recompute  the  LLR  values,  any  vector  x  that  has  its 
LLR  value  decrease  significantly  is  most  likely  just  a  perturbation  of  xmax/  and  when  used  as  an  initializer 
for  an  optimization  routine,  will  converge  to  the  same  point.  Since  this  will  result  in  an  identical/ duplicate 
track,  it  is  necessary  to  remove  this  solution.  This  process  is  repeated  iteratively  -  using  the  reduced  data 
set,  the  xmax  corresponding  to  the  new  maximum  LLR  value  was  selected  (in  the  example  this  would  be  the 
solution  corresponding  to  the  LLR  value  of  12.5),  and  the  process  was  repeated.  In  this  manner,  the  top  200 
LLR-producing  solutions  were  reduced  to  10  solutions.  These  10  solutions  were  then  optimized  using  the  EM 
algorithm,  and  again,  the  process  of  "solution  reduction,"  as  described  above  by  picking  the  maximum  (now 
optimzied)  LLR  value,  excising  measurements  associated  with  the  xmax  solution,  recomputing  the  LLR  vector 
and  taking  the  ratio  was  performed.  In  this,  manner,  the  number  of  solutions  was  reduced  to  four  -  these  were 
used  at  each  update  as  potential  track  initiation  points. 

This  algorithm  worked  very  well,  especially  when  compared  to  ML-PDA  track  initialization  routines  used  in 
[5]  and  [8],  which  used  much  simpler  two-point,  one-point  or  grid  initialization  schemes.  These  schemes  simply 
took  a  large  number  of  trial  points,  created  the  LLR  at  all  these  points,  and  then  optimized  N  (usually  around 
20)  of  the  initialization  vectors  that  corresponded  to  the  top  N  LLR  values.  While  this  simpler  method  was 
successful  in  finding  tracks,  it  generally  initiated  more  duplicate  tracks  than  the  method  described  above,  and 
was  somewhat  slower.  This  slowness  was  due  to  the  fact  it  had  to  optimize  more  vectors  (which  is  expensive) 
in  order  to  account  for  the  duplicate  tracks  that  it  would  likely  find. 

2.5  Track  Maintentance 

Track  maintentance  was  done  exactly  the  same  as  it  was  for  the  ML-PDA  algorithm  described  in  [8].  Briefly,  all 
tracks  were  given  an  integer  health  value  between  0  and  5,  with  all  new  tracks  being  assigned  a  track  health 
value  of  2.  At  each  update,  each  existing  track  was  projected  forward  and  optimized.  If  the  optimized  LLR  value 
of  the  projected  point  exceeded  the  LLR  threshold,  the  track  health  value  was  incremented,  up  to  a  maximum  of 
5.  Otherwise,  the  track  health  value  was  decreased.  When  the  track  health  value  of  a  track  reached  0,  the  track 
was  terminated.  Additionally,  if  a  track  update  resulted  in  a  speed  that  exceeded  a  maximum  speed  threshold, 
the  track  was  dropped  immediately. 
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2.6  Multitarget  Tracking 

The  ML-PMHT  log-likelihood  ratio,  as  given  in  equation  (4),  was  developed  for  a  single  target.  Unlike  ML- 
PDA,  this  likelihood  ratio  expression  is  naturally  extensible  to  multiple  targets.  Consider  an  example  with  two 
targets,  with  state  vectors  given  by  xi  and  X2.  The  log-likelihood  ratio  in  this  case  for  a  batch  of  data  is  given 
by 

Nw  rrii  /  \ 

A(^l x)  =  (  n°  +7riy{p[zj(i)|xi]py(t)  +P[zj-(*)|x2]p2j(t)}  )  (24) 

1=1  j= i  \  ) 

Here,  the  assumption  is  made  that  the  probabilities  of  a  measurement  originating  from  target  1  or  target  2  are 
equal  (this  need  not  be  the  case).  In  this  target  assignment  model,  for  each  scan,  any  number  of  measurements 
can  be  assigned  to  clutter,  any  number  of  measurements  can  be  assigned  to  target  1,  and  any  number  of  mea¬ 
surements  can  be  assigned  to  target  2.  However,  it  is  important  to  note  that  any  given  measurement  is  either 
assigned  to  clutter,  to  target  1  or  to  target  2. 

There  is  a  practical  problem  with  using  this  expression,  however,  in  the  tracking  application.  Consider  the 
case  where  one  target  exists,  and  another  target  appears.  In  this  case,  the  LLR  expression  is  given  by  (24).  For 
track  declaration,  it  is  necessary  to  determine  if  the  "addition"  to  the  LLR  by  the  second  track  is  enough  to 
exceed  some  threshold  and  declare  the  track.  In  this  case,  the  "extra"  LLR  due  to  the  second  track  is  given  by 


Nw 

\  '  \  '  , 


AA(Z|x)  = 

i= 1  3= 1 


1  + 


n1Vp\zj(i)\x2\p2j(i) 

^ To  +  ■niVp[7.j{i)\y.1]pij(i) 


(25) 


The  added  LLR  that  we  will  use  to  determine  if  target  2  should  be  declared  is  not  only  dependent  on  target  2, 
but  also  on  target  1.  This  just  gets  worse  the  more  targets  there  are.  The  "extra"  LLR  value  for  the  nth  target  will 
be  a  function  of  all  the  previous  n  —  1  targets.  It  is  desireable  in  terms  of  track  declaration  to  have  a  decision 
on  the  nth  target  depend  on  data  from  that  target  alone,  so  for  actual  implementation,  multitarget  tracking  for 
ML-PMHT  was  done  in  a  similar  fashion  to  ML-PDA.  When  updating  an  existing  track  or  declaring  a  new 
track,  measurements  from  other  existing  tracks  were  probabilistically  excised  from  the  data  prior  to  evaluating 
the  LLR  ratio  for  the  track  against  a  threshold.  It  was  possible,  however,  to  use  the  EM  algorithm  to  optimize 
for  a  track  while  taking  into  account  already  existing  tracks.  This  capability  was  used  for  ML-PMHT  tracking. 


3.  ML-PMHT  VS.  ML-PDA  ON  DATA  SETS 

The  ML-PMHT  tracker  was  applied  to  two  synthetic  data  sets:  the  TNO  'blind'  data  set  from  2008,  and  the  2009 
Metron  data  set.  These  results  are  compared  to  previously  obtained  results  for  ML-PDA. 

3.1  TNO  Blind  Results 

The  TNO  Blind  data  set  was  created  by  Pascal  de  Theije  in  2008  [3].  In  consists  of  a  single  scenario  with  three 
source-receiver  pairs  and  four  targets.  ML-PDA  results  (originally  done  as  part  of  [8])  are  shown  in  Figure  1. 
ML-PMHT  results  are  shown  in  Figure  2. 

Metrics  for  both  ML-PDA  and  ML-PMHT  trackers  are  shown  in  Table  1.  Both  the  metrics  and  the  plots  show 
that  overall,  the  performance  of  the  two  algorithms  is  roughly  equivalent. 

3.2  Metron  2009  Results 

The  second  data  set  analyzed  was  a  synthetic  data  set  developed  by  Metron  in  2009  [7].  This  data  set  consisted 
of  five  different  scenarios;  the  ground  truth  was  provided  for  the  first  four  scenarios.  Each  scenario  was  multi¬ 
static  with  four  transmitters  and  25  receivers. 

This  was  an  extremely  challenging  data  set  due  to  the  large  number  of  source-receiver  pairs,  the  low  proba¬ 
bility  of  detection  of  the  target  for  a  given  source-receiver  pair  (about  0.1)  and  the  relatively  large  measurement 
errors  [7].  As  an  example  of  the  difficulty  of  this  dataset,  all  of  the  measurements  for  a  window  of  data  for 
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Figure  1.  ML-PDA  TNO  blind  data  set  results 


Figure  2.  ML-PMHT  TNO  blind  data  set  results 
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Fragmentation 

Duplicate  Tracks 

Percentage  of 
Time  in  Track 

RMSE  (m) 

ML-PDA  Results 

TNO  Target  1 

0 

0 

100  % 

32.16 

TNO  Target  2 

0 

0 

80% 

35.65 

TNO  Target  3 

0 

0 

82% 

20.63 

TNO  Target  4 

1 

0 

99% 

24.27 

ML-PMHT  Results 

TNO  Target  1 

0 

0 

95% 

37.60 

TNO  Target  2 

3 

0 

87% 

44.68 

TNO  Target  3 

0 

0 

86% 

57.29 

TNO  Target  4 

0 

0 

95% 

19.35 

Table  1.  ML-PDA  and  ML-PMHT  TNO  blind  data  set  metrics 


scenario  1  are  plotted  in  figure  3.  There  are  four  targets  moving  in  straight  lines  in  this  window,  yet  their 
trajectories  are  not  visible  in  the  plot. 

Metrics  for  both  ML-PDA  and  ML-PMHT  are  shown  in  Table  2.  Plots  of  the  five  different  scenarios  for 
the  two  algorithms  are  shown  in  Figures  4  through  13.  As  with  the  TNO  data,  there  do  not  appear  to  be  any 
glaringly  apparent  differences  in  the  performances  of  ML-PMHT  and  ML-PDA  on  this  dataset.  Quantitatively, 
in  terms  of  the  metrics  in  Table  2,  the  results  between  ML-PDA  and  ML-PMHT  are  similar.  While  there  are 
instances  where  one  algorithm  outperforms  the  other  for  a  certain  target  in  a  certain  scenario,  there  is  no  con¬ 
sistent  pattern  where  ML-PMHT  outperforms  ML-PDA  or  vice-versa.  Qualitatively,  the  results  seen  on  the 
plots  are  to  first  order  the  same.  Overall,  the  performances  of  ML-PMHT  and  ML-PDA  were  good  for  this 
dataset.  Future  work  should  use  Monte  Carlo  simulations  to  better  evaluate  the  differences  between  these  two 
algorithms. 


Figure  3.  All  measurements  in  a  window  of  data  from  Metron  scenario  1. 
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Figure  4.  ML-PDA  results  for  Metron  scenario  1  (with  truth) 


Figure  5.  ML-PMHT  results  for  Metron  scenario  1  (with  truth) 
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Figure  6.  ML-PDA  results  for  Metron  scenario  2  (with  truth) 
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Figure  7.  ML-PMHT  results  for  Metron  scenario  2  (with  truth) 
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Figure  8.  ML-PDA  results  for  Metron  scenario  3  (with  truth) 


Figure  9.  ML-PMHT  results  for  Metron  scenario  3  (with  truth) 
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Figure  10.  ML-PDA  results  for  Metron  scenario  4  (with  truth) 


Figure  11.  ML-PMHT  results  for  Metron  Scenario  4  (with  truth) 
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Figure  12.  ML-PDA  results  for  Metron  scenario  5 


Figure  13.  ML-PMHT  results  for  Metron  scenario  5 
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4.  CONCLUSIONS 


Overall,  the  ML-PMHT  algorithm  seems  to  perform  as  well  as  the  ML-PDA  algorithm  for  the  two  datasets 
considered.  The  computed  metrics  are  roughly  equivalent,  and  the  quality  of  the  tracks,  as  judged  from  the 
plots  above,  are  also  roughly  equivalent.  Future  work  should  be  directed  towards  creating  simulation  data  that 
can  be  used  for  Monte  Carlo  testing,  which  will  provide  a  more  rigorous  comparison  between  ML-PMHT  and 
ML-PDA. 
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